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ABSTRACT 


Dimensional  analysis  is  a  method  used  in  the  design  and  analysis  of  experiments  in  the 
physical  and  engineering  sciences.  When  a  functional  relation  between  variables  is 
hypothesized,  dimensional  analysis  can  be  used  to  check  the  completeness  of  the  relation 
and  to  reduce  the  number  of  experimental  variables.  The  approach  is  extended  to  include 
dimensions  pertaining  to  cognitive  processes  so  that  it  can  be  used  in  the  design  of 
multi-person  experiments.  The  proposed  extension  is  demonstrated  by  applying  it  to  a 
single  decisionmaker  experiment  already  completed;  new  results  from  that  experiment  are 
described.  It  is  then  applied  to  the  design  of  a  multi-person  experiment. 


Paper  to  be  presented  at  the  4th  IFAC/  IFORS  /IEA  Conference  on  Man-Machine  Systems, 
Xi’an,  China  September  1989. 
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EXPERIMENTAL  DESKIN  AND  EVALUATION  OF  BOUNDED  RATIONALITY 
USING  DIMENSIONAL  ANALYSIS1 


Victoria  Y.  Jin 
Alexander  H.  Levis 

Laboratory  for  Information  and  Decision  Systems.  Massachusetts  Institute  of  Technology 
Cambridge,  MA  02139,  USA 


Abstract.  Dimensional  analysis  is  a  method  used  in  the  design  and  analysis  of  experiments  in  the 
physical  and  engineering  sciences.  When  a  functional  relation  between  variables  is  hypothesized, 
dimensional  analysis  can  be  used  to  check  the  completeness  of  the  relation  and  to  reduce  the 
number  of  experimental  variables.  The  approach  is  extended  to  include  dimensions  pertaining  to 
cognitive  processes  so  that  it  can  be  used  in  the  design  of  multi-person  experiments.  The 
proposed  extension  is  demonstrated  by  applying  it  to  a  single  decisionmaker  experiment  already 
completed:  new  results  from  that  experiment  are  described.  It  is  then  applied  to  the  design  of  a 
multi  person  experiment. 

Keywords.  Man-machine  systems;  dimensional  analysis;  experimental  design;  cognitive 
workload. 


INTRODUCTION 

In  the  last  few  years,  a  mathematical  theory  for  the  analysis  and 
design  of  information  processing  and  decisionmaking 
organizations  has  been  developed  based  on  the  model  of 
interacting  human  decisionmakers  (DMs)  with  bounded 
rationality  t  Levis,  1984;  Boettcher,  1982).  While  this  model 
was  motivated  by  empirical  evidence  from  a  variety  of 
experiments  and  by  the  concept  of  bounded  rationality 
(March.  1978),  there  were  no  direct  experimental  data  to 
support  it  An  experimental  program  was  undertaken  to  test 
the  theorv  and  obtain  values  (or  the  model  parameters  (Louvet 
et  al,  1988). 

One  of  the  major  difficulties  in  developing  a  model-driven 
experimental  program  is  the  large  number  of  parameters  that 
have  to  be  specified  and  varied.  The  resulting  problem  has  two 
aspects:  (a)  T  he  parametrization  of  the  experimental  conditions 
leads  to  a  very  large  number  of  trials,  a  situation  that  is  not 
really  feasible  when  human  subjects  are  to  be  used,  and  (b)  Not 
all  experimental  variables  can  be  set  at  the  values  required  by 
the  experitnen  .nl  design  because  of  the  lack  of  direct  control  of 
the  cognitive  variables. 

Consequently,  some  orderly  procedure  is  needed  that  will  allow 
the  reduction  of  the  number  of  experimental  variables  and, 
more  importantly,  that  will  lead  to  variables  that  are  easier  to 
manipulate.  Such  an  approach,  called  dimensional  analysis,  has 
been  in  use  in  the  physical  and  engineering  sciences 
(Hunsacker.  1947;  Gerhart,  1985).  The  purpose  of  this  paper 
is  to  extend  the  approach  to  problems  that  have  cognitive 
aspects  so  that  it  can  be  used  for  the  design  and  analysis  of 
experiments  The  class  of  problems  we  are  interested  in  are 
those  that  relate  organizational  structure  directly  to 
performance,  as  measured  by  accuracy  and  timeliness  and, 
more  indirectly,  to  cognitive  workload. 

A  special  class  of  organizations  will  be  considered  -  a  team  of 
well-trained  decisionmakers  executing  repetitively  a  set  of 
well  defined  cognitive  tasks  under  severe  time  pressure.  The 
cognitive  limitations  of  decisionmakers  '—poses  a  constraint  on 
th*  organizational  performance.  Performance,  in  this  case,  is 
assumed  to  depend  mainly  on  the  time  available  to  perform  a 
task  and  on  the  cognitive  workload  associated  with  the  task. 
When  the  time  available  to  perform  a  task  is  very  short  (time 

'This  work  was  conducted  at  the  MIT  Laboratory  for 
Information  and  Decision  Systems  with  support  provided  by 
the  U  S  Office  of  Naval  Research  under  Contract  No. 
N 00014  84-K-0519  (NR  649  003). 


pressure  is  very  high),  decisionmakers  are  likely  to  make 
mistakes  so  that  performance  will  degrade. 

Dimensional  analysis  will  be  introduced  briefly  in  the  next 
section.  The  approach  is  then  extended  to  include  cognitive 
variables  and  a  completed  experiment  will  be  used  as  an 
example  to  demonstrate  the  approach.  Then,  the  application  of 
dimensional  analysis  to  the  design  of  experiments  for  the 
analysis  and  evaluation  of  distributed  decisionmaking 
organizations  will  be  described. 


DIMENSIONAL  ANALYSIS  AND 
EXPERIMENTAL  DESIGN 

Dimensional  analysis  is  a  method  for  reducing  the  number  and 
complexity  of  experimental  variables  which  affect  a  given 
physical  phenomenon.  A  detailed  introduction  to  dimensional 
analysis  can  be  found  in  Hunsacker  (1947);  Gerhart  ( 1985). 

Dimensions  and  Units.  A  dimension  is  the  measure  which 
expresses  a  physical  variable  qualitatively.  A  unit  is  a  particular 
way  to  express  a  physical  quantity,  that  is,  to  relate  a  value  to  a 
dimension.  Fundamental  dimensions  are  the  primary 
dimensions  which  characterizes  all  variables  in  a  physical 
system.  For  example,  length,  mass,  and  time  are  fundamental 
dimensions  in  mechanical  systems.  A  dimension  such  as 
length  per  time  is  a  secondary  or  derived  dimension  If  the 
dimension  of  a  physical  variable  cannot  be  expressed  by  the 
dimensions  of  others  in  the  same  equation,  then  '!.A  vr.ri-'le  is 
dimensionally  independent. 

The  foundation  of  dimensional  analysis  is  the  Principle  of 
Dimensional  Homogeneity,  which  states  that  if  an  equation 
truly  describes  a  physical  phenomenon,  it  must  be 
dimensionally  homogeneous,  i.e.,  each  of  its  additive  terms 
should  have  the  same  dimension.  The  basic  theorem  of 
dimensional  analysis  is  the  it  theorem,  also  called 
Buckingham's  theorem: 

it  theorem:  If  a  physical  process  is  J-'-vtibed  by  a 
dimensionally  homogeneous  relation  involving  n 
dimensional  variables,  such  as 

X^ffXj.Xj . xn)  (1) 

then  there  exists  an  equivalent  relation  involving  (n-k) 
dimensionless  variables,  such  as 

it  I  =  F(it2.  H3 .  itn.fc)  (2) 


i 


where  k  is  usually  equal  to,  hut  never  greater  than,  the 
number  of  fundamental  dimensions  needed  to  describe  ail 
s  s 

Pach  of  the  z  s  in  Eq  1 2)  is  formed  by  combining  (k+1)  xs  to 
form  dimensionless  variables.  Comparing  F.qs.  (1)  and  (2).  it 
•s  clear  that  the  number  of  independent  variables  is  reduced  by 
k.  where  k  is  the  maximum  number  of  dimensionally 
independent  variables  in  the  relation.  The  proof  of  the  tt 
theorem  can  be  found  in  Gerhart  ( 1985). 

1  he  z  theorem  pros  ides  a  more  efficient  way  to  organize  and 
manage  the  variables  in  a  specific  problem  and  guarantees  a 
reduction  of  the  number  of  independent  variables  in  a  relation. 
Dimensionless  variables,  also  called  dimensionless  groups,  are 
formed  by  grouping  primary  variables  with  each  one  of  the 
secondary  variables. 

lo  apply  dimensional  analysis  to  decisionmaking 
organizations,  die  fundamental  dimensions  of  the  variables  that 
describe  their  behavior  must  be  determined.  A  system  of  three 
dimensions  is  shown  in  Table  1  that  is  considered  adequate  for 
modeling  cognitive  workload  and  bounded  rationality.  An 
experiment  conducted  at  MIT  (Loir  et  et  at. ,  1988)  is  used  to 
demonstrate  the  application  of  dimensional  analysis  to  the 
experimental  investigation  of  bounded  rationality.  The  purpose 
of  this  single-person  experiment  was  to  investigate  the  bounded 
rationality  constraint.  The  experimental  task  was  to  select  the 
smallest  ratio  from  a  sequence  of  comparisons  of  ratios 
consisting  of  two  two-digit  integers.  Two  ratios  were 
presented  to  a  subject  at  each  lime.  The  subject  needed  to  decide 
the  smaller  one  and  compare  it  with  the  next  incoming  ratio 
until  all  mhos  were  compared  and  the  smallest  one  was  found. 
The  controlled  variable  (or  manipulated  variable)  was  the 
amount  of  time  allowed  to  perform  the  task.  The  measured 
variable  was  the  accuracy  of  the  response,  i.e.,  whether  the 
correct  ratio  was  selected. 


TABLE  1  Dimensions  for  Cognitive  Problems 


Dimension 

Symbol 

Units 

3  ime 

T 

second 

Information 

I 

bit 

t  uncertainty) 

Task 

S 

symbol 

The  controlled  s  ariablcs  were  the  number  of  comparisons  in  a 
sequence,  denoted  by  N.  and  the  allotted  time  to  do  the  task, 
denoted  by  T,A  For  each  value  of  N.  where  N  could  take  the 
value  of  three  or  six,  T*  took  twelve  values  with  constant 
increment  in  the  following  way: 

T.»  =  I  2  25,  3.  3.75 .  10  5  )  second  for  N  -  3: 

T*.  =  (  4.50,  6,  7.50 .  20. 1  )  second  for  N  =  6. 

The  performance  was  considered  to  lie  accurate  or  ■'omect  if  the 
sequence  of  comparisons  was  completed  and  if  the  smallest 
ratio  selected  w  as  correct.  The  details  of  the  experiment  can  be 
found  in  Loin  et  ( 1988). 

for  human  decision  makers.  When  the  allotted  time  is 
decreased,  there  will  be  a  time  beyond  which  the  time  spent 
doing  the  task  will  have  to  be  reduced,  if  the  execution  of  the 
task  is  to  be  completed.  This  will  result  in  an  increase  in  the 
information  processing  rate  F,  if  the  workload  is  kept  constant. 
H  >wever.  die  bounded  rationality  constraint  limits  the  increase 
of  F  to  a  maximum  value  Fmav  When  the  allotted  time  for  a 
panic ul.tr  tack  becomes  so  small  that  the  processing  rate  reaches 
Fm.,,.  further  decrease  of  the  allotted  time  will  cause 
perlomiance  to  degrade.  It  was  hypothesized  that  the  bounded 
rationality  constraint  Fma,  is  constant  for  each  individual  DM, 
but  varies  from  individual  to  individual.  The  bounded 


rationality  constraint  can  be  expressed  as 

Fm«-0/T/  (3) 

where  Tw*  is  the  minimum  allotted  time  before  performance 
degrades  significantly.  G  and  Tw  vary  for  different  tasks,  but 
Fmat  is  constant  for  a  decision  maker,  no  matter  what  kind  of 
tasks  he  does.  Therefore,  significant  degradation  <jf 
performance  indicates  that  the  allotted  time  approaches  Tw 
Observation  of  this  degradation  during  the  experiment  allows 
the  determination  of  the  lime  threshold  and.  therefore,  the 
maximum  processing  rate,  provided  the  workload  associated 
with  a  specific  task  can  be  estimated  or  calculated. 

The  retroactive  application  of  dimensional  analysis  to  this 
experiment  will  be  shown  step  by  step. 

Step  1  Write  a  dimensional  expression. 

In  the  experiment,  accuracy,  Nr,  of  information  processing  and 
decisionmaking  is  defined  as  tne  number  of  xrrect  decisions, 
that  is,  the  number  of  correct  results  in  a  sequence  of 
comparisons.  Therefore.  Nc  has  the  dimension  of  symbol  and 
depends  on  the  following  variables: 

N:  number  of  comparisons  in  each  trial; 

Tw:  allotted  time  to  do  N  comparisons; 

H:  uncertainty  of  input,  that  is,  the  uncertainty  of  the 

ratios  to  be  compared  in  a  trial; 

The  dimensional  expression  is 

Nc  =  f(Tw.  N.  H  )  (4) 

First,  dimensional  analysis  checks  whether  this  functional 
relation  could  describe  the  relation  between  Nc  and  other 
variables.  The  dimensions  of  the  variables  in  Eq  (4)  are  the 
following: 

I  Nc  1  =  S  [T  J  =  T 

|N|  =  S  HU  =1 

Since  the  dimension  of  Nc  is  S.  the  right  hand  side  of  Fq.  (4) 
has  to  be  of  the  same  dimension  regardless  of  w  hat  the  function 
f  is.  However,  all  three  fundamental  dimensions  are 
represented  by  the  three  independent  variables  There  is  no 
way  lo  combine  these  variables  to  obtain  a  term  of  dimension  S 
only.  Therefore,  according  to  the  Principle  of  Dimensional 
Homogeneity,  this  functional  relation  is  not  a  correct 
expression  of  the  relation  under  the  investigation. 

There  are  two  approaches  to  obtain  the  correct  relation.  The 
first  is  to  delete  Tw  and  H.  This  is  not  acceptable  because  the 
allotted  time  is  a  critical  factor  in  this  experiment.  The  other 
approach  is  to  add  some  variables  or  dimensional  constants  to 
satisfy  the  requirement  for  dimensional  homogeneity 
Dimensional  constants  are  physical  constant  such  as  gravity, 
the  universal  gas  constant,  and  so  on.  No  such  dimensional 
constant  has  been  identified  as  yet.  therefore,  some  variables 
which  have  dimensions  of  time  and  information  should  he 
added  to  the  relation.  Moreover,  the  additional  variables  base 
to  be  relevant  to  the  measurement  of  accuracy.  Since  the 
experiment  is  to  investigate  hounded  rationality,  that  is.  the 
maximum  information  processing  rate,  it  is  appropriate  to 
introduce  processing  rate  F  into  the  equations.  The  equations 
describing  accuracy  and  response  time  become 

Nc  =  f(Tw,  N,  H,  F)  (5) 

Each  ot  liu-  equation-,  is  d.inensionaily  ho.-.nger.cou'  4Her» 
are  five  dimensional  variables  in  Fq.  (5).  that  is.  n  =  5. 

Step  2  Determine  the  number  of  dimensionless  groups. 

The  number  of  dimensionless  variables  is  equal  to  n-k.  where  k 
is  the  maximum  number  of  dimensionally  independent  variables 
in  Eq.  (5).  Dimensions  of  the  variables  are 

I  Nc|  ~  S.  IN]  =  S  |T*|=T, 

I  H  1  =  I.  I  F  |  =  IT  I 
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The  nminnim  number  of  dimensionally  independent  variables 
is  three.  I  licrefore.  k  is  equal  to  three.  Then,  the  number  of 
dimensionless  groups  is: 

n  -  k  =  5  -  3  =  2. 

There  will  be  two  dimensionless  groups  in  the  dimensionless 
equation  corresponding  to  Eq.(5). 

Step  3  Construct  the  dimensionless  groups. 

While  the  choice  of  primary  variables  is  essentially  arbitrary, 
consideration  should  be  given  that  the  dimensionless  groups  be 
meaningful.  If  Tw,  N,  and  H  are  selected  as  the  three  (k=3) 
primary  variables,  two  dimensionless  groups  are  constructed 
on  the  basis  of  the  remaining  variables  Nc  and  F  in  Eq.(5).  As 
an  example,  a  dimensionless  group  rt|  is  formed  by  combining 
Tw,  N.  II.  and  F.  Using  the  power-product  method,  7t|  can  be 
determined  by  the  following  procedure.  Write  n j  as 

it,  -=  Twa  N'b  IIC  Fd 

w  here  a,  b.  c,  and  d  are  constants  that  make  the  right  hand  side 
of  the  equation  dimensior less,  so  that  the  equation  is 
dimensionally  homogeneous  In  terms  of  the  dimensions  of 
Tw,  N,  U.  and  F  we  have 

[nil  =  [Sn  In  T°l  =  [T|a  [I|b  [SP  [IT-'jd 

-  fa  d  [h+d  3c 


By  the  Principle  of  Dimensional  Homogeneity,  the  following 
set  of  simultaneous  algebraic  equations  must  be  satisfied. 

For  T:  a  -  d  =  0 

For  I:  b  +  d  =  0 

ForS:  c=0 


There  are  three  equations,  but  four  unknowns.  The  solution  is 
not  unique.  In  general,  the  choice  of  the  solution  depends  on 
the  particular  interest  in  the  subject.  For  our  purpose,  the 
secondary  variables,  in  this  example  Nc  and  F,  are  chosen  to 
appear  in  the  first  power,  that  is.  d  is  set  equal  to  unity.  Thus, 
by  solving  the  set  of  algebraic  equations,  we  obtain: 


a  =  !,  h  =  c  =0,  d  =  1. 

Then 

ft,  =F/(H/TW)  (6) 

Using  the  same  power-product  method,  itj  is  found  to  be 
7l2  =  Nc  /  N  (7) 

Then,  the  dimensionless  form  of  Eq.  (5)  is 


N. 

N 


■'Vi 


(8) 


design  procedure  for  new  experiments  later  in  this  paper  ''  his 
is  the  result  obtained  by  the  application  of  dimensional  annly  sis 
The  functions  H*  is  unknown  and  need  to  be  determined  by 
experiments. 

In  Eq.  (10),  Jt2  is  the  fraction  of  correct  decisions;  and  it| 
represents  the  ratio  of  the  actual  processing  raie  and  the  average 
rate  of  input  uncertainty.  Equation  (10)  represents  a 
model-driven  experiment  in  which  rt|  is  the  experimental 
variable  to  be  controlled  The  function  needs  to  he 
determined  experimentally. 

Comparing  Eq.(5)  and  Eq.(IO),  one  finds  that  die  number  of 
independent  variables  is  reduced  from  four  to  one.  This 
reduces  the  complexity  of  the  equations  and  facilitates 
experiment  design  and  analysis  Properly  designed  experiments 
using  dimensional  analysis  provide  similitude  of  experimental 
condition  for  different  combinations  of  dimensional  variables 
which  result  in  the  same  value  of  it  s.  Similitude  reduces  the 
number  of  trials  needed  to  be  run  in  order  to  define  'V  This  is 
a  major  advantage  when  the  physical  (dimensional) 
experimental  variables  cannot  be  set  at  arbitrary  values. 


APPLICATION 

One  of  the  objectives  of  this  papei  is  to  illustrate  the  use  of 
dimensional  analysis  for  the  design  and  analysis  of 
model-driven  experiments.  Therefore,  only  new  results  from 
the  earlier  experiment,  obtained  using  dimensional  analysis, 
will  be  shown.  The  following  procedure  was  used  to  analyze 
the  data.  Only  three  subjects  are  selected  from  the  population  of 
all  subjects  (25  subjects)  for  illustration. 

Data  for  each  trial 

Control  variables  Measured  variables  Computed  variables 


N,TW  Nc,  Tf  H,  J.G 

In  this  analysis.  N  is  fixed  and  its  value  is  three  (3).  H  and  G 
are  computed  using  Information  theory.  H  is  constant  for  the 
experiment,  and  G  depends  on  the  algorithm  used  hv  a  subject 
to  do  the  task;  therefore,  it  varies  across  the  subjects.  The 
details  of  ihese  computation  can  be  found  in  Louvet  (1988).  J 
is  the  ratio  of  the  number  of  correct  decisions  Nc  to  the  number 
of  total  decisions,  N.  The  controlled  variable  in  each  trial  is  Tw. 
As  stated  previously,  there  are  12  values  of  Tw. 

Step  1:  Compute  the  input  uncertainty  H  and  the  workload  for 
all  algorithms  used  by  the  subjects.  The  workload  is  denoted  by 
G'  for  the  i,b  algorithm. 

The  following  steps  are  carried  out  for  each  subject. 

Step  2:  Let  L  denote  the  set  that  indexes  the  trials  with  the  j,b 

value  of  Tw,  denoted  by  Twj:  Ij=(  1,2,3 . nj).  The  following 

average  quantities  are  computed  for  each  Twc 


Looking  at  Eq  (8)  carefully,  we  find  the  all  variables  except  F 
are  directly  controllable  or  measurable.  If  the  actual  processing 
time  Tf  is  introduced,  then  the  actual  processing  rate  F  can  be 
expressed  by 


where  G  is  the  workload  associated  with  the  f'C 
I  he  actual  processing  time  Tf  can  be  measured  ditectly. 
Therefore,  substitution  of  G/Tf  for  F  is  necessary  so  that  all 
variables  in  F.q.(8)  are  directly  accessible.  After  the 
substitution.  Eq.(8)  becomes 


n 


where  j  =  1 .2 . 12. 

Step  3:  Compute  the  two  dimensionless  groups  for  each  Ttt: .  j 
-  I  .2 .  12. 


*2  =  ^  =  *<  (10) 
Tw 


_  G _ *1. 

i  H  Tr. 


I  his  introduction  of  Tf  will  be  very  useful  in  developing  a 


where  k  is  the  index  of  the  algorithm  used  hv  the  subject  Since 
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[here  are  12  values  of  Tw-  iif  and  its  also  have  12  values  each. 

Siep  4:  Find  relations  between  ?t  j  and  in.  Equation  (10)  can 
be  rewritten  as: 

J=4'(it1  ) 

since  J  is  identical  to  its. 

In  order  to  determine  the  function  4*.  the  mean  value  of  J,  as 
calculated  in  step  3,  is  plotted  against  the  independent  variable 
it  j .  The  resulting  plot  for  one  subject  is  shown  on  Fig.  1. 


From  these  relations,  the  critical  value  of  it  j .  it,  *,  can  be  found 
for  each  subject  according  to  some  specilic  accuracy 
requirement  For  example,  the  value  of  it,  for  which  J  is  equal 
to  J*,  is  given  by: 


J*  is  the  accuracy  corresponding  to  itj*  at  which  further 
decrease  of  It)  can  cause  a  significant  drop  of  J. 
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Fig.  1.  Mean  J  vs.  it  |  for  subject  53 


An  exponential  function  is  used  to  fit  the  curve.  The 
exponential  function  is 

y  =  a  +  b  *Exp.(-c*(it-Ho))it  >  itq 

where  a,  b,  c,  and  itg  are  constants  to  be  determined.  By 
considering  that  the  maximum  possible  value  of  J  is  one  and  the 
minimum  value  Jq,  a  and  b  can  be  determined  as  1  and  (Jo-1) 
respectively.  Then,  we  have 

y  =  1  +  (J0-l)  *Exp(-c*(it-it0)) 

A  Least  Squares  method  is  used  to  determine  c  and  icq  when 
assuming  a  value  for  Jq.  The  criterion  is  that  Jp  is  chosen  so 
that  the  sum  of  the  squares  of  residuals  is  minimized.  The 
resulting  function  is  plotted  in  Fig .2,  along  with  the  data. 
Figures  3  an  4  show  comparable  results  for  two  other  subjects. 
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Fig.  4.  Mean  J  vs.  it|  for  subject  46 


When  the  entire  data  set  is  processed,  then  the  distribution  of 
Jt | *  can  be  obtained,  in  a  manner  analogous  to  that  used  by 
Louvet  et  al.  to  determine  the  distribution  of  the  critical 
response  times.  This  information  helps  specify  the  range  of 
some  experimental  parameters  in  the  multi-person  experiment. 

The  determination  of  the  dimensionless  groups  and  the 
estimation  of  the  'F  completes  the  use  of  dimensional  aneK  sis. 
The  determination  of  the  dimensionless  groups  and  the 
estimation  of  the  'V  completes  the  use  of  dimensional  analysis. 


RESULTS 

One  of  the  critical  questions  in  any  experiment  design  is  the 
determination  of  the  ranges  of  manipulated  parameters  We 
want  to  choose  the  ranges  of  these  parameters  so  that  the 
measured  variables  will  have  significant  differences  and  can  be 
interpreted  in  a  meaningful  way.  The  results  from  above 
analysis  are  useful  for  this  design  purpose. 

Actual  processing  time  Tt 

The  first  result  is  obtained  through  the  introduction  of  the  actual 
processing  time  Tf  and  the  determination  of  a  functional  relation 
between  Tf  and  the  allowed  time,  Tw.  A  proposition  is 
formulated  on  the  basis  of  the  experimental  data 

Definition  A  task  is  said  to  have  been  completed  if  and  only  if 
all  necessary  actions  required  by  the  task  are  taken  before  the 
allowed  time  expires,  that  is,  Tf  <  Tw 

Proposition  1  When  a  task  is  completed,  it  is  completed  in  less 
time  than  the  allowed  time,  that  is,  T,  <  Tw  .  How  muih  less 
depends  on  the  length  of  the  allowed  time. 

Proposition  1  confirms  the  functional  relation  between  Ij  and 
Tw  and  is  used  later  in  this  paper  to  determine  the  range  for  the 
allowed  time  to  assure  the t  the  operating  point  is  close  to  the 
bounded  rationality,  but  does  not  exceed  it 

The  functional  relation  be  ween  response  time  T(  and  allowed 
time  Tw  has  been  found  to  be  exponential,  as  show  n  in  Fig  5 
and  Fig. 6.  This  exponential  relation  implies  that  T,  increases 
with  Tw  quickly  at  the  beginning  until  Tu  reaches  a  point 
beyond  which  Tf  does  not  change  with  Tw  The  reason  for  this 
behavior  is  intuitive:  when  there  is  ample  time  to  do  a  job,  the 
effect  of  the  time  on  the  performance  will  become  irrelevant 
This  result  is  useful  in  the  multi-person  experiment  design  in 
two  ways. 
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First.  Tf  leads  to  a  better  estimate  of  the  processing  rate  because 
it  is  the  time  actually  used  in  processing  the  information. 
Therefore,  the  bounded  rationality  can  be  expressed  by 

Fmax=G/Tf*  (11) 

where  Tf*  is  the  Tf  at  which  J  =  J*. 

Second,  the  functional  relation  between  Tf  and  Tw  allows  us  to 
predict  the  response  time  for  a  given  Tw  .  The  existence  of  the 
region  in  which  fu.ther  increases  of  Tw  do  not  result  in  any 
significant  change  in  Tf  indicates  the  time  pressure  imposed  by 
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Fig. 5  Response  time  Tf  vs.  available  time  Tw  for  subject  28 
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Fig .6.  Response  time  Tf  vs.  available  time  Tw  for  subject  53 


Ty,  does  not  affect  the  performance  any  more.  Thus,  through 
Tf,  we  can  avoid  those  values  of  Tw  which  will  not  have  any 
effect  on  performance. 

Dimensionless  parameter  ^ 

The  second  result  obtained  from  dimensional  analysis  is  the 
dimensionless  parameter  tc j  which  provides  knowledge  on  the 
values  of  the  design  variables  H,  G,  and  Tw,  As  stated 
previously,  the  critical  value  of  7t|,  denoted  by  rt]*,  is  the  value 
at  which  any  small  decrease  of  it|  will  cause  a  significant 
decrease  in  accuracy.  To  determine  how  to  use  the  information 
given  by  it)*,  we  first  consider  how  the  subjects  process 
information  and  make  decisions  respectively,  then  we  describe 
how  it]  *  can  lead  to  a  design  procedure. 

When  looking  at  the  algorithms  used  by  the  subjects,  we  find 
that  the  subjects  can  be  categorized  into  two  different  groups 
according  to  the  ways  they  make  decisions.  The  first  group  of 
subjects  attempts  to  simplify  the  ratios  as  soon  as  the  ratios  are 
presented,  then  make  a  decision  according  to  the  simplified 
version  of  the  data.  They  try  to  filter  out  an  amount  of 
information  so  that  only  a  minimum  amount  of  information 
necessary  to  make  the  decision  is  kept.  On  the  other  hand,  the 
second  group  of  subjects  look  at  the  raw  data  carefully  before 
making  any  reduction.  When  processing  the  data,  they  retain  a 
large  amount  of  information  which  may  be  used  in  making  a 
decision. 

Wohl  (1981)  has  described  a  model  developed  by  Johnson 
(1978)  in  which  individual  styles  of  decision  making  are 
classified.  In  the  model,  Johnson  identified  two  decision  styles 
in  gathering  information,  spontaneous  and  systematic.  Table  2 
list  the  traits  of  these  two  styles.  By  using  Johnson's  model  of 
decision  styles,  we  can  describe  the  decision  style  of  the  first 


group  as  spontaneous,  while  of  the  second  group  as 
systematic.  The  division  of  the  subjects  into  the  two  groups  is 
shown  in  Table  3.  The  average  values  of  workload,  G.  and  the 
maximum  processing  rate,  Fmai,  of  different  groups  are 
shown  in  Table  4.  These  values  indicate  that  the  subjects  in  the 
systematic  group  have  higher  processing  rate  than  those  in  the 
spontaneous  group.  One  cautious  observation  is  that  the 
maximum  rate  is  not  proportional  to  the  workload  when 
decision  styles  vary. 

Next,  we  discuss  how  to  use  tt|*  to  design  new  experiments. 

TABLE  2  Characteristics  of  Decision  Styles 


Spontaneous 

-  A  holistic  reaction  to  events 
reacts  to  total  experience 

•  Quick  psychological  commitment 
Personalize  alternatives  in  order  to  evaluate  them 

-  Flexible  goal  orientation 


Systematic 

-  Collective  reaction  to  situations/events. 
Breaks  experience  into  segments  and  reacts 
separately  to  each  one 

-  Cautious  psychological  commitment 

-  Methodical  goal  orientation 


TABLE  3  Division  of  the  Subjects  in  Different  Groups 

Group 

Number  of  Subjects 

Spontaneous 

10 

Systematic 

15 

TABLE  4  Average  Values  of  Different  Groups  of  the  Subjects 


Group 

Av.G 

Av-  f*max 

Spontaneous 

212  6 

45.3 

Systematic 

257.6 

86.0 

The  critical  value  of  ltj,  it)*,  of  an  individual  subject 
characterizes  his  bounded  rationality.  The  expression  of  rr ,  in 
Eq.(  10)  can  be  rewritten  as 


.(G)— L- 

ir  t, 

<fL) 


Then,  rt|*  is 


kT  =  (G 
1  H 


(Tf/Tw)*  is  the  ratio  of  critical  response  time  and  the  allowed 
time  corresponding  to  J*.  According  to  Proposition  l,  Tf  w  ill 
become  smaller  and  smaller  if  Tw  is  decreasing.  When  the 
accuracy  J  is  equal  to  J*,  Tf  and  Tw  become  Tf*  and  Tw* 
respectively.  Thus,  (Tf/Tw)*  characterizes  the  cognitive  inertia 
of  an  individual  in  accelerating  the  processing  rate  to  reach  the 
maximum  rate,  Fmav  On  the  other  hand,  the  ratio  of  G/H 
depends  on  a  particular  task  and  protocols.  Thus,  when  G/H 
changes,  (TpTw)*  will  vary  accordingly  to  maintain  Fmax  to  be 
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I  he  same  Consequently,  rt|*  will  not  change.  Therefore,  Jl|* 
is  the  value  which  can  be  used  in  designing  new  experiments. 
Let  us  call  the  experiment  described  above  as  the  calibration 
experiment  on  the  bounded  rationality  of  individuals.  The 
follow  ing  procedure  is  developed  to  design  new  experiments. 


EXPERIMENT  DESIGN 

The  procedure  for  designing  experiments  to  study  the  effects  of 
organizational  structures  on  performance  is  described  as 
follow  s. 

At  the  start  of  design,  the  average  value  of  it]*  is  given  by  the 
calibration  experiment.  And  in  accordance  with  Proposition  1, 
the  exponential  relation  derived  from  the  calibration  experiment 
is  adopted.  The  critical  value  for  the  design  is 

V=G/H(TW/Tf)*. 

or  G/H  =  tij*  ( Tf/  Tw  )*  (15) 

w  here  G.  H.  and  Tw  are  design  parameters. 

•  G  depends  on  H  and  the  organizational  structure,  that  is,  the 
particular  procedure  and  protocol; 

-  H  can  be  controlled  by  designing  the  task; 

-  Tw  is  the  driving  parameter  for  the  tempo  of  the  operations. 

-  tt|*  is  given. 

The  design  steps  are  as  follows. 

Step  I  Design  H. 

Design  a  task  according  to  the  hypothesis  being  tested  by  the 
experiment.  The  input  uncertainty  H  of  the  task  can  be 
computed. 

Step  2  Design  G. 

Design  an  organizational  structure  which  will  perform  the  task. 
Then,  the  particular  protocol  and  procedure  can  be  specified  for 
the  organization.  Workload  associated  with  the  protocol  and 
procedure  is  computed. 


Determine  the  values  of  the  allowed  time  Tw.  Since  H  and  G 
are  know  n  from  steps  1  and  2,  Equation  (15)  can  be  rewritten 
as 


Tl 


Tw- 


Twmax 


Tw 


Fig.  7  An  example  of  determining  the  values  of  Tw 


freedom  on  the  choice  of  tasks  and  organizational  structures  to 
design  appropriate  experiments  for  various  hypotheses. 

Step  5  Calibration  of  subjects. 

Design  a  questionnaire  to  determine  the  decision  style  of  a 
subject.  This  calibration  helps  the  experimenter  to  make  a 
preliminary  assessment  as  to  which  group  that  subject  may 
belong  and  to  choose  the  parameter  set  for  a  particular  set  of 
trials. 


CONCLUSIONS 

Dimensional  analysis  has  been  introduced  to  the  design  of 
experiments  that  have  cognitive  aspects.  An  extension  has  been 
presented  that  makes  it  possible  to  include  variables  such  as 
cognitive  workload  and  bounded  rationality  of  human  decision 
makers.  An  existing  single  person  experiment  has  been  used  as 
an  example  to  show  how  the  methodology  can  be  applied.  A 
new  result  from  the  existirg  experiment  has  been  presented  to 
illustrate  the  possible  advantages  of  using  dimensional 
analysis.  Note  that  dimensional  analysis  only  determines 
possible  relations  between  relevant  variables;  the  actual 
functional  expression  has  to  be  found  from  experimental  data. 
Then  it  was  shown  how  these  results  can  be  used  to  design 
model-driven  experiments. 


I  Tf/  Tw  )*  =  (  G/H)/  tt|*  (16) 

To  decide  the  critical  value  of  Tw,  the  functional  relation 
between  Tf  and  T  v  is  used.  Substitute  Tf  =  f(Tw)  into  Eq.(16) 
to  obtain 

<f(Tw)/Tw)*=(G/H)/Ji,*  (17) 

From  F.q.  (17)  the  value  of  Tw  *  can  be  computed.  Then  Tf*  is 
estimated.  Fma,  is  computed  using  Eq.  (11). 

Use  of  Tf  =  f(Tw)  and  Eq  (16)  permits  the  determination  of  the 
range  of  Tw  which  satisfies  the  constraints  specified  by  the 
designer  For  example,  the  interval  R  in  Fig.  7  is  the  interval 
from  which  the  values  of  T,,  are  taken  so  that  the  operating 
point  will  be  in  an  appropriated  range.  Twmai  is  the  value  at 
w  hich  Tf  docs  not  change  significantly  with  Tw,  or  in  terms  of 
time  pressure,  the  speed  of  he  operation  does  not  critically 
depend  on  the  time.  The  values  of  Tw  outside  the  interval  are 
either  too  small  to  allow  the  subject  to  carry  out  the  task  (the 
bounded  rationality  constra  nt)  or  too  large  to  observe  any 
variation  of  Jt2  with  tt|  (no  effect  on  performance). 

Step  4  Check  all  design  and  computed  values. 

List  II.  G,  Tw*.  Tf*.  Fma„,  and  create  a  table  for  Tw  and 
corresponding  values  ot  Tf  and  F.  If  there  is  any  undesired 
value,  the  designer  can  go  back  to  step  1  to  make  modifications 
until  he  is  satisfied. 
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According  lo  Eq  (16),  the  critica  values  of  Tf  and  Tw  will 
change  when  either  the  task  or  the  organizational  structure 
changes.  Therefore,  the  experiment  designer  can  use  the 
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